Algorithms for image saliency via sparse representation and multi-scale inputs image retargeting.
نویسنده
چکیده
Saliency detection is an important yet challenging task in computer vision. In this report we investigate the use of sparse coding over redundant dictionary for saliency detection. We attempt to present a small fraction of the growing knowledge regarding sparse representation over redundant dictionary and discuss some potential usage of this powerful tool for saliency detection task. We propose a new algorithm for saliency detection based on the likelihood that an image patch can be encoded sparsely using a dictionary learned from other patches. experimental results based on saliency ground of truth of 1000 real images shows a superior performance of the new algorithm in comparison with other existing saliency algorithms. We also propose an image retargeting algorithm which is capable of combining the strength of the Shift-map framework and warping-based algorithms. The Shift-map algorithm experiences problems with extreme resizing ratio: important objects might be removed due to limited space in the output. We tackle this problem by introducing a stack of multi-scale inputs. This kind of input allows the Shift-map framework to produce output with great flexibility: regions can be removed or scaled in order to achieve the optimal and desired retargeted image. Experiments are conducted based on a benchmark image database to demonstrate potential power of this approach. ATTENTION: The Singapore Copyright Act applies to the use of this document. Nanyang Technological University Library
منابع مشابه
Compressed-Sampling-Based Image Saliency Detection in the Wavelet Domain
When watching natural scenes, an overwhelming amount of information is delivered to the Human Visual System (HVS). The optic nerve is estimated to receive around 108 bits of information a second. This large amount of information can’t be processed right away through our neural system. Visual attention mechanism enables HVS to spend neural resources efficiently, only on the selected parts of the...
متن کاملImage Classification via Sparse Representation and Subspace Alignment
Image representation is a crucial problem in image processing where there exist many low-level representations of image, i.e., SIFT, HOG and so on. But there is a missing link across low-level and high-level semantic representations. In fact, traditional machine learning approaches, e.g., non-negative matrix factorization, sparse representation and principle component analysis are employed to d...
متن کاملFusion of Thermal Infrared and Visible Images Based on Multi-scale Transform and Sparse Representation
Due to the differences between the visible and thermal infrared images, combination of these two types of images is essential for better understanding the characteristics of targets and the environment. Thermal infrared images have most importance to distinguish targets from the background based on the radiation differences, which work well in all-weather and day/night conditions also in land s...
متن کاملDeblocking Joint Photographic Experts Group Compressed Images via Self-learning Sparse Representation
JPEG is one of the most widely used image compression method, but it causes annoying blocking artifacts at low bit-rates. Sparse representation is an efficient technique which can solve many inverse problems in image processing applications such as denoising and deblocking. In this paper, a post-processing method is proposed for reducing JPEG blocking effects via sparse representation. In this ...
متن کاملHyperspectral Image Classification Based on the Fusion of the Features Generated by Sparse Representation Methods, Linear and Non-linear Transformations
The ability of recording the high resolution spectral signature of earth surface would be the most important feature of hyperspectral sensors. On the other hand, classification of hyperspectral imagery is known as one of the methods to extracting information from these remote sensing data sources. Despite the high potential of hyperspectral images in the information content point of view, there...
متن کامل